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Practices 



The focus of a summative evaluation of the Promising 
Diffusion Project was on solicitincr descriptions and views 
of several different groups about project operation and merit and 
comparing the "ideal" model against what had taken place so far. 
Preliminary activities involved review of the project-developed 
Implementation Kit for Regional Coordinators, project objectives, and 
project components. Four special inquiries were conducted; (1) survey 
of local awareness, (2) survey of Project Directors, (3) survey of 
1979-80 local adopters/adapters of Promising Practices, and (U) 
survey/interviews with the sixteen Regional Coordinators, Over 
two-thirds of the respondents to the Local Awareness Survey had 
received the Promising Practices Handbook. Most had read it. 
Director Survey inquired about means of learning about the 
and opinion of local level awareness. The Survey of Local 
Adopters/Adapters asked about their support of the project, use of 
evaluation instruments, usefulness of different kinds of assistance, 
suggestions for future changes, and facilitating and limiting 
factors. Regional directors answered opinion and open-ended questions 
and were interviewed. Results generally indicated that the Project is 
successful and important. (Results of the surveys are summarized in 
detail,) Twelve major recommendations were made regarding the project 
and its continuation, (All evaluation instruments are appended,) 
(YLB) 
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INTRODUCTION 



the summative evaluation was designed to address four fundamental 

questions. These questions receive final attention and discussion in 

the Conclusions and Recommendations section of this report. 

K What difference has existence of the Project made? Is it 
worth a continued effort? 

2. Which components of the Promising Practices (PP) diffusion 
model are essential for most effective dissemination of the 
Practices? 

3. Can the diffusion process be expected to continue and/or increase 
in viability without the continued presence of a central coordi- 
nator, at least in the short-run? 

How should the Department of Education allocate dollars if it 
continues to support the diffusion process in I98O-8I? 

Relatively little evaluator time was spent reviewing the extent to 
which specific Diffusion Project objectives were accomplished. The 
Project Director's report addresses much of this aspect of accountability. 
Also, no attempt was made to evaluate the merits of the Promising 
Practices themselves. The focus then, was on soliciting descriptions 
and views of several different groups about Diffusion Project operation 
and merit and comparing the 'Mdeal'* diffusion model (components, oper- 
ation, and outcomes) against what has taken place thus far. 

Special thanks go to the following individuals whose assistance 
has been instrumental to the evaluation effort: Dr. Helen Hall, 
Project Director; Eugene Vinarskai and Rich Schmidt, Department of 
Education; and the sixteen Regional Coordinators. 
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1.0 PRELIMINARY ACTIVITIES AND EVALUATION DESIGN/METHODS 
1.1 Kit Review 

A draft of the Implementation Kit for Regional Coordinators , 
one major product of the Project, was reviewed and several suggestions 
for revision made. In particular, it was found that limited references 
to evaluative materials were included which might prove helpful to local 
adopters and adapters of Practices interested in assessing program impact. 
An ERIC search by Nancy Hargis of the Department of Education and a 
search by the evaluator resulted in the identification of only a modest 
number of useable materials which were recommended for citation in the 
Kit . ' 

An earlier review of the Promising Practices in Oregon handbook 
(orange; referred to as the Handbook throughout the report) revealed 
that few (one, I believe) of the original Practices listed had made use 
of methods other than self-review or a third partJy to evaluate program 
effectiveness. Adopters or adapters, then, have little or no readily 
accessible evaluative instruments for use when implementing a Promising 
Practice. Because of this deficiency, the additional effort was made 
to find resource materials for adopter/adapter use to include in the 
J<rt. Success, however, was limited due both to time constraints and the 
scarcity of easily identifiable material. 

A form for use by Regional Coordinators to review the draft Kit 
was developed and mailed by Dr. Hall in April 1980 (see Appendix). 
The mail responses from Regional Coordinators as well as a special review 
session held with two Coordinators highly involved with adopting/ 
ddapting activity at the local level this year completed K\t_ review 
activities. Further evaluation of Kit useability must await its final 
production and dissemination this summer or Fall. 

1.2 Design/Methods 

The evaluation was designed to provide information about Project 
operation and impact for use by all who will be involved in deciding 
its future direction. 
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Suinmative Evaluation Desiijn Overview 



Question 



Gource(s) of 
Inforiiiation 



1. Have Project activities been conipleteo' 
as planned? To nhat extent has each 
been coihpleted? 

2. Is there evidence to suggest the diffusion 
nctyK)rk niodol is now in place, and will 

it work in the abscence of a statewide 
central facilitator role? 

a. Are written materials useable, under- 
standable? any gaps? 



H.Hall 

(Project Cirector) 



RC's; H.Hall; 3rc 
Farcy [valuator review 
of draft Kit 



I'lC'si H.fiall; F,. 



b. Is the inforriial and formal cottnitment 
cf RC'g sufficient to sustain the process? Lch(iiidt(CLE) 
I'hat more is needed? 



aware of the PP network? 

d. What is the level of interest of local 
persons in adopting or adapting a FP? 

e, Must the state continue to play a role(s) 
to ensure PP network viability? Are 
alternative facilitative vehicles neeoed? 



3. lihat would be an optimal way for the state 
to spend available dollars for PP diffusion 
in IGfO-Gl? 



are sent the PP Handbook 

H.Hall; those at local 
level who receive the 
PP Handbook; PC's 

H.Hall; RC/s; ODE staff; 
local adopters/adapters 



all of the above 



Methodls) 



Time 



Final Project Report; 
Checklist 



'une 



written survey/interviews Anr-^y 
of RC's; adopters/adapters 
survey in-mail 

written survey/intervieivs l',ay 
of RC's; H.Hall and Gchnidt 
interviews 



c. Are prospective adopters at the local level Those at local level wfio in^nail survey 



April 



written survey/intervie/,' of I-'ay-June 
RC's; H.Hall interview; in- 
mail Gurve} of local folk 

written survey/interviews f.ioiy 
of RC's; H.Hall interview; 
in-mail survey of local 
adopters/adapters; inter- 
view ODE staff 



all of the afcove 



June 



EMC *Regional Coordinators 
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A draft design was presented to the Project Steering Committee 
at its March 26, I98O meeting and finalized thereafter* Figure 1 
presents an overview of the design and the Inquiry methods used. Copies 
of the instruments used are attached in the Appendix. Response rates 
for each of these instruments are shown below in Figure 2 (see Figure 1 
on the following page). 

Figure 2 
Response Rates to Surveys 



Survey 


No. Di stributed 


No. 


Returned 


% Respons 


Survey of Local 
Awareness 


325 (from 1 ist used by 
ODE to distribute 
handbook) 


132 






Survey of Project 
Directors (of PP's) 


m (representing 38 
Pract ices) 


31 




7k% 


Survey of Local 

Adopters/Adapters, 

1979-80 


2^ (includes 12 Bus. 
Ed. Open Lab 
teachers) 


16 


(includes 7 
Bus. Ed. Open 
Lab teachers) 


67* 


Survey/ Interviews 
of Regional Coordi- 
nators 


16 


13 


(but al 1 con- 
tacted by 
phone) 


81* 

(100% b 
phone) 



2.0 PROJECT OBJECTIVES AND A REVIEW OF DIFFUSiON NETWORK WODEL 
ASSUMPTIONS 

Before reviewing the findings from the multiple kinds of inquiries 
made about Project operation and impact, a brief review seems in order 
of Project objectives and the assumptions made by Project designers, 
as perceived by this evaluator, about how a successful diffusion network 
will work. 

Basically, the Project had three major goals: 

develop a regional system, through Regional Coordinators, for 
the dissemination of recognized '^Promising Practices" to 
other Oregon school districts; 



provide technical assistance and coordination for pilot sites 
in 1979-80; and 

develop a network and process with Regional Coordinators 
to carry on dissemination activities after withdrawal of 
state coordination support. 

As defined in the draft J<[t, the term ''dissemination'* Includes in its 
formal definition "implementation" activities. "Implementation" is 
defined as "the facilitation of adoption/adaption, installation and 
Improvements" of selected programs. The 1979-80 Diffusion Project, then, 
was designed to put in place in the various regions of the state an 
on-going set of activities and procedures, with leadership from. Reg ional 
Coordinators, which encourage further adoption and adaption of Promising 
Practices in Career and Vocational Education currently In use. The hope 
was that at the year's end such regional activity could proceed in the 
absence of central state-wide coordinative support. Specific technical 
and coordinative activities of the Project staff for 1979-80 were to 
result in the "in place" statewide network for on-going dissemination. 

Major components of the idealized network model would seem to Include 
the fol lowing: 

Existence of an up-to-date descriptive listing of available 
Promising Practices (PP's) of sufficient variety to be of 
maximum local Interest. 

Awareness by Regional Coordinators (RC's) of the PP's - 
what they are, what they can offer local schools. 

Availability of PP Project Director consulting time and 
written materials for use by potential adopters and adapters 
who request assistance. 

Awareness by RC's of how to obtain dollars and other resources 
to assist with local adoption/adaption projects. 

Local school personnel awareness of the PP's and the kinds 
of adopter/adapter support available and how to obtain it. 

Perception by RC's that one or rnore PP could be of value to 
local districts or schools. 

The various surveys and interviews conducted were also designed to examine 
the existence of each of these fundamental conditions. Figure 3 is an 
attempt to summarize the essential components and processes of the 
"ideal" network model. 
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facilitate obtaining 
resources for adoption/ 
c.daption 



Cocunented Experiences 
via Pilot Sites with 
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Process 
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State Dollars for 
Travel, Substitutes, etc 
related to Adoption/ 
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Project Directors of 
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Materials 
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3.0 A REVIEW OF 1979-80 PROJECT ACTIVITIES 

in an effort to achieve the on-going diffusion network model, Project 
staff engaged in a variety of activities. While the Project report 
more fully describes each of these activities, a quick review of them 
is presented in this report before turning to the major evaluation find- 
ings. Figure k provides an overview of major project activities. 

After reviewing Project activities and discussions with Dr. Hall, 
Project Director, several observations can be made. 

3.1 Many PP's which are no longer operating are described in the 
Handbook which is widely distributed throughout the state. Project 
staff Inquiries scaled the "current" listings In the August 1979 
Handbook down from 66 to 37- A project is currently underway to pursue 
further and expand the Promising Practices listings. The project is 
funded by the Department of Education. 

Figure k 

Overview: Major Project Activities 



Activities/Outcomes 


Mechani sms 


(P Identifying Current Promising 
Pract ices 


• Contact with all Project Directors 

• Reduction of list to 37 



(D Identifying/Selecting Adoption/ 
Adaption Projects/Sites (9 PP's 
involving 13 counties) 



Q Developing Resource Materials 
( Kit ) for Use by RC's 



• General publicity (brochure, news- 
letter articles, prof, mtgs.) 

• Meetings with RC's 

• Field visits (6) 

• Making awards, transferring $'s 



• RC input to Kit development 
. Drafting Kit 

• Further review of Ki t by RC's 



® Answering Questions from Local 
Folk about PP's 



Response to letters, phone calls 
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3.2 It took a while to identify all the resulting pilot adoption/ 
adaption projects and sites; that is, not all had been identified by 
the end of Fall 1979. At least six field visits were made by Dr. Hall 
to work with potential local adopters/adapters and/or the Regional 
Coordinator to develop an application for Project participation and 
resource support. Early meetings and discussions with Regional Coordi- 
nators at their monthly meeting in Salem seems to have generated strong 
interest from five of the sixteen coordinators. 

3.3 Considerable energy was devoted to publicizing the existence 
of the Project. Primary reliance was placed on printed media, though 
a special exhibit and in-person presentations to several forums took 
place (e.g. ICCE representatives, Research-Exemplary Advisory Committee 
members,, Oregon externs. Career Education Coordinators in Morrow/ 
Umatilla counties). The printed Project brochure was the primary and 
most widely disseminated printed source of information used about the 
Project. 

3.^ At least four visits were made to pilot sites and/or sites 
of original Promising Practices by Dr. Hall. 

3.5 Special meetings were held with staff at Linn-Benton Community 
College, the Northwest Regional Educational Laboratory, and several 
others. A particularly important workshop was held with Project Directors 
of Promising Practices (December 7, 1980). All Project Directors were 
invited to the workshop along with Regional Coordinators and invited 
guests. The purpose of the workshop was to clarify and strengthen the 
future role of these Project Directors as consultants to local adopter/ 
adapter staffs. While attendance was somewhat disappointing (with one- 
third of the Project Directors and five Regional Coordinators in atten- 
dance), workshop ratings from the participants were uniformly very 

high. 

3.6 Considerable effort was given to development of the Implementation 
Ki t for Regional Coord inia tors . Al 1 Coordinators reviewed a first draft 

and offered suggestions for improvement. Further, two who were highly involved 
with this year's pilot adoption/adaption projects met with Dr. Hall 

ERIC ^ 
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to review further suggested changes to the Kit. An evaluation 
of the usefulness of the resulting final version of the Kit 
must await its publication this summer or Fall. 

3.7 Dr. Hall asked the Coordinators to identify any local 
projects which they felt might qualify as a Promising Practice 
and be added to the list. Only two local projects were identi- 
fied. 

3.8 Finally, Dr. Hall devoted considerable administrative 

time to the task of negotiating, reviewing, awarding and facilitating 
the transfer of Project funds to the local pilot sites. 

^.0 MAJOR FINDINGS 

Results from the following special inquiries are summarized: 
survey of local awareness of the Promising Practices Program; 
survey of Project Directors (of original Promising Practices); 
survey of 1979-80 local adopters/adapters of Promising Practices; 
and survey/interviews with the sixteen Regional Coordinators. 
Instruments used are attached in the Appendix. 

^.1 Local Awareness Survey 

Almost one-third {23%) of th Dse responding (total response 
rate was , who are on the Promising Practices Handbook mailing 
list (N=about 350) of the Department of Education, said that in the 
past they had not received this publication. 

Of jthe 7U who said they had received the Handbook (or at 
least remembered receiving it), 93% either scanned it (65%) 
or read it thoroughly (28%); most (8l%) shared it with others. 
Forty-two percent said they had followed up for more information 
about a Practice; 3^% said they still planned to do so in the future; 
and 61% said they were not sure about future follow-up. Forty- 
four percent said either they or local colleagues have been 
interested in adopting or adapting one or more of the Practices 
1 i sted. 
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Finally, only one-third of those responding said "Yes" they 
had received a brochure describing the Diffusion Project (1979-80) 
while ]3% said "No" and almost one-half were not sure if they 

had received it* 

One respondent said updates to the Handbook were not received, 
and another suggested the Practices and the Project be highlighted 
in county in-service programs. 

4.2 Project Director Survey* 

Thirty-one responses from k2 persons representing 38 
Promising Practice projects were received. Two-thirds Indicated 
they had been contacted by at least one person interested In 
their Practice. Of these, 50% indicated one to five such contacts; 
18i said five to 10 such contacts; while almost one-third (32%) 
said they had received 10 or more such inquiries. A gross extra- 
polation from these data suggest that at least 200 inquiries have 
been received by these Project Directors. Without previous baseline 
data, it is difficult to judge whether such a level of Inquiries 
is high or low. 

Directors are contacted most often by mail (58%), followed 
by phone (k2%) and personal visits (39%). 

When asked how those making the inquiries had learned of their 
project, the greatest number, 48%, said through the Promlslag 
Practices Diffusion Project; 26% said through Regional Coordinators; 
16% through professional publications; and 16% through local 
administrators. Ten percent said those contacting them had learned 
of the project through local coordinators of career or vocational 
education. 

Directors were asked their opinion about the extent to which 
those at the local level were aware of Promising Practices Projects. 
None said "extremely aware" while two-thirds said "somewhat aware" 
and one-third said either "little awareness" (26%) or *'no aware- 
ness (7%). 

*some percent responses add to rnore than 100 because more than one 
response category could be checked in the survey Item. 
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"Sharing copies of the materials*' (7U) was the most common 
way assistance was provided to those making inquiries. Other 
methods were: "talked on phone"--52%; "trip to the school"— 
28%*; ''technical assistance on gratis basis""29%; and "technical 
assistance on contractual basis""3%. 

When asked "Should Promising Practices dissemination efforts 
continue", k7% said "yes, high priority" while 50% said "yes, limited 
level" and only one person said "not at all." 

^.3 Survey of Local Adopters/Adapters 

Approximately $15,117 of total Project dollars were 
allocated to thirteen sites for the adoption or adaption of nine 
different Promising Practices. Most of these dollars supported 
the initial planning phase of the adoption/adaption process. 

An estimated forty-three local teachers and counselors were 
directly involved in these pilot efforts, not counting Project 
Directors of the original Promising Practice. At least 280 
students have been involved already in these efforts (with 220 
of them participants in the Job Skills Fair project). Most projects, 
including the DSH Consortium project in Polk-Yamhill counties 
and the Career Guidance Project involving eight counties in 
Eastern Oregon, will move to full implementation in I98O-8I . 
For 1980-81, local staff expect student participation to increase 
to ^50+ not counting the potential thousands of students who could 
be affected by the Polk-Yamhill and Eastern Oregon projects. 

Overall, local adopters/adapters are highly supportive 
of the Project. When asked "In your view, should support for the 
Promising Practices Diffusion Project continue?", eleven of the sixteen 
responding said "yes, as is" (69%) while the other five said 
"yes, but with some changes" (31%). No one said "no". 

Eleven of the sixteen indicated that Regional Coordinators had 

*no explanation is available for the discrepancy in percent between 
this item and the earlier one about the form of the contact. 
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alerted them to the program; three each said they learned of the 
program by Promising Practices publications and Helen Hall; and 
two each said Department of education, school administrator, or 
"other". 

Half expect their projects to expand to serve more students 
next year while seven of the sixteen expect things to remain about 
the same. Two (both Business Education project sites) said they 
will probably not reach the implementation phase. 

Project Directors were asked about the use of evaluation 
instruments and strategies to gauge achievement of project outcomes. 
Since most projects were in the planning stage in 1979-80, this 
question proved not very relevant. Nine (56%) said "too early to 
tell", five said "informal student feedback" (3U), and two each 
said "staff impressions", "third party evaluator" or "formal student 
feedback". One respondent indicated the ."use of student performance 
or behavioral measures" (one of the Business Education open lab 
sites) and two reported use of a "formal ^ .dent feedback" in- 
strument (one of the Business Education open lab sites and the 
Career Action School -CE2). 

Major activities of those adopting or adapting a Practice 
were: arranging for and/or participation in special in-service 
workshops; on-site visitations; and reviewing and revising instruct- 
ional and/or guidance materials. 

Reasons given for electing to become involved with implementing 
a Practice varied greatly but included the following recurring 
themes: to promote the better use of funds; a specific local need 
for the program; the improvement of instructional or career guidance 
program quality; and the avoidance of costly "reinvention of the 
wheel". 

Table 1 summarizes the kinds of assistance used in the adoption 
or adaption processes and how each was rated on usefulness. 
Clearly, the forms of assistance most used as well as the ones found 
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to be the most useful were: assistance from OSU staff, travel 
reimbursement, in-person assistance from original Promising 
Practice project staff, and dollars to support substitute staff. 

Perhaps somewhat surprisingly, six of the 15 adopter/adapter 
respondents did not make use of written materials on the original 
Promising Practice. Four persons indicated "no need" for these 
materials and two said such materials were not available. 

Results related to use of in-service training programs prior 
to implementing a Practice were somewhat mixed. Of the thirteen 
who responded to this item, seven indicated using this form of 
assistance while three said it was not available. One respondent 
said such in-service should be a required component of the adoption/ 
adaption process. 

Suggestions made about what future changes should be made in 
the Diffusion Project were the following: 

• Obtain agreement from district administration to 
implement the Practice before involving local staff in 
the adoption/adaption process 

• support for planning time during the summer months 

» opportunities to talk with teachers using Open Lab 
arrangements (e.g. how they face various problems) 

• Project expansion to make more districts aware of 
the Practices and the Diffusion Project 

• more attention to research on the degree of success 
of various Practices 

• move Diffusion Project staff out of the Home Economics 
Dept. at Oregon State University 

• require an in-service component in adoption/adaption 
projects 

• keep Diffusion Project staff on the road more and 
in direct contact with local adopters/adapters 
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TAdLE 1 



Kinds of Assistance Used by Adopters/ 
Adapters and Assistance (Jcefulness * 





Assistance 


Used 


Did Hot I 
Because: 


Jse 




Usef ulne 


SS 1 

1 










Did Not 
Need 


Lovj 


f':eciium 


Hich • 


1. 


Asst, by phone fror. original 
project staff 


0 


1 


3 






0 




2. 


Asst. in person from original 
project staff 


13 


1 








lo 






Adx.in. asst. fronj RC 


11 


1 


1 


1 


2 


8 




A. 


Tech. asst. fronr. KC 


10 


1 


2 


1 


2 


7 




5. 


Asst. from CSU PP staff 


15 










15 




€ . 


Asst. frcnr. outside consultant 
not paid for by Project funds 


4 


3 


4 




3 


1 




7. 


Asst. frox, outside consultant 
paid for by Project funds 


5 


2 


4 










S. 


Other "people-related" asst. 
(staff at schools visited) 


4 


2 


3 




1 


3 




9. 


Collars to support released 
time for staff 


11 




1 




1 


10 




10. 


Dollars to pay for substitute 
staff 


13 




2 






13 




11. 


Dollars for supr^lies, services, 
equipment 


8 


2 


2 




2 


6 




12. 


Dollars for travel reimburse- 
rrent 


15 








I 


14 




13 . 


Other "dollar-related" 


1 


2 


5 






1 




14. 


v/ritten materials about original 
croject 


9 


2 


4 




2 


7 




Il5. 


In-service training program 
orior to implementinp Practice 


7 


3 


3 




1 


6 





persons responding; only total nmiber of responses are shoMle.g. not percents) 



20 

o 
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Local adopters and adapters were asked to identify the "most 
important' factors which facilitated the adoption/adaption process and 
those which limited or rendered the process more difficult. Factors 
listed were the following: 



Faci 1 i tat ing Factors 



Limiting Factors 



released time 

the sharing and pool ing of ideas 
and practical examples from other 
schools 

field trips 

support from local school admin. 

coordination with other Regional 
Coord inators 

cooperation of OSU staff 

ease of application procedures 



inability to get away from 
school enough 

wanted to do more than I had 
time for 



lack of initial set-up time 
money to add more classes 
planning started too late 

could have used more money 
no in-service built in 
school faci 1 i t ies 
staff turnover 



k.k Survey/ Interview of Regional Coordinators (RC's) 

Responses to each of the survey items are presented followed 
by a discussion of follow-up interview results. 



S urvey Responses 

a. Thoughts about future of the Diffusion Project 
cont inue as i s 
continue with minor changes 



support it in concept, but substantial 8 
changes needed 



discontinue it 



1 
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Your formal responsibi 1 i ties/role wi th the Project 

The variety of responses given indicate that roles and 
responsibilities are viewed differently across the RC's. 
Some emphasize a very pro-active role on behalf of 
Promising Practices which includes publicizing and then 
facilitating the obtaining of support for local adaption/ 
adoption projects. Others indicate that while their 
job is to be familiar with the Promising Practices, 
even more important is an awareness of local needs; 
and then when and where need is indicated, Promising 
practices may be recommended for local review. Most indicated 
they thought their role was clear (only one said it 
was not). In general, most RC's described themselves 
as "brokers,*' persons who are advocates of the needs 
of local staff and then attempt to identify supportive 
resources and processes which can respond to these 
needs. 

Project involvement this year 

Only three RC*s indicated no involvement this year. Three 
indicated very extensive involvement with one or more 
pilot adoption/adaption projects. Such involvement 
included organizing consortium, arranging for various 
meetings; extensive discussion with local admini- 
strators, teachers and counselors; ass i stance to local 
staff with making application for Project funds; and 
the dissemination of information about Practices and the 
Diffusion Project in general. The remaining ten 
Coordinators seemed to have had minimal involvement 
which took one or more of the following forms: local 
project planning committee attendance; d i scuss ion wi th 
local vocational directors of the Promising Practices 
Handbook; attendance at a regional meeting to discuss 
consortium formation; and attendance at an in-service 
workshop. 
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d. Emphasis placed on Promi s ing-Pract ices-related activities 
compared with other program of work activities 

Much less 2 

Less 2 

About the same 7 

htore 1 

Much more 0 

No answer k 

e. Compatibility of Promising Practices-related activities and 
objectives with the accomplishment of other work objectives 

Not very 0 

Usually 1 

Somewha t 2 

Very 10 

No Answer • 3 

f. Local ESD Administrators expect you to place emphasis cn 
Promising Practices-related activities 

No 7 

Yes, some 5 {k of these also recommended 

the Project be continued as is) 

Yes, quite a bit 1 
No answer 3 

g. Awareness among local educators of the Diffusion Project 

Don ' t know 0 

No t ve ry 5 

Somewhat 7 

Very ] 

No answer 3 

1. Primary ways local educators learn about the Promising 
Practices and opportunities to adopt or adapt a Practice 

Reg ional Coo rd i na tors 7 

Attendance at meetings 3 

Direct publicity from 
Diffusion Project 3 

Word-of-mouth 2 

Other (Handbook, mailings) 2 
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Local interest expressed in adopting or adapting a Practice 

• Inquiries received this year 

none ^ 

one i| 

two to five 3 

six ] 

twe 1 ve ] 

'•many" ) 

no answer 3 
. Were all inquiries accomodated? 

yes 8 

no 2 
. Expect a change in level of interest for next year? 

no, about the same 9 

yes, less 0 

y^^' '"ore ^ (3 of these said the 

Pro ject shoul d be 
continued as is 
next year) 

no answer 3 

Will the RC Network alone be sufficient to maintain Project 
V lab i 1 i ty next year? 

no 8 

yes 6 

not sure 2 

Suggested uses of I98O-8I dollars to support the diffusion 
of Promising Career and Vocational Education Practices 
in Oregon 

Alternative No. Times Checked 

Devote considerable energy to expand- 9 
ing current list of Practices and 
allow dollars to be used to adopt/ 
adapt from th i s list 

have RC's submit local project pro- 7* 
posals directly to ODE staff for 
review and dollar allocation 



Alternative No. Times Checked 

continue to fund a 3rd ly facilitator 6 
to provide technical i stance to local 
staff and facilitate e implementation 
process 

continue to allocate dollars to support 5 
the current model 

divide-up all dollars among ESD's and us k 

prearranged priority adoption/adaption 

projects 

have ODE staff target dollars to one or more k 
special Practives for diffusion 

devote energy to Improving use of evaluation 3 
measures/strategies at local level 

other (mandatory in-service for all adoption/ 2 
adaption projects; support a dissemination 
component in each ODE- issued RFP) 

make all funds available to a particular 0 
region(s) of the state where Interest \n 
adoption/adaption is high 

make all funds available to a particular 0 
region(s) where it is determined need is 
greatest 

Current strengths/weaknesses of the diffusion effort* 
Strengths 

1 . concepts good (k) 

2. excellent projects and sources 
for ideas (2) 

3- the materials themselves (1) 

enthusiastic Coordinator (1) 

5. dollars for substitutes, per 
diem travel (1 ) 

6. method of dissemination/funding (1) 

7. fast turn-around on funding 
proposals (1 ) 

Number of RC*s mentioning each is in parentheses 
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L. continued 

Weaknesses 

1. Diffusion model assumptions (3) 

• that districts want to adopt 

• that to express interest in adoption requires admission 
that local ,-)ractice is no good 

• that only "packaged programs" are "transportable," 

when it's the concepts themselves that are transportable 

2. Promising Practices Handbook 

• out-of-date; "historic" rather than "Promising" practices (3) 

• too narrow a list; needs expansion (3) 

. needs an expanded format; current one doesn't 
really tel 1 very much (1 ) 

3. Selling a Practice locally 

. need more and better publicity, especially in-person 
contacts with those involved with a Promising Practice; 
send out various write-up highlights of Practices per- 
riodically (e.g. via flyer, newsletter copy) (5) 

• hard to sell local administrators (1) 

• district fear of assuming long-term costs (1) 

• no way to help districts identify objectives which would 
be better served by a PP; in the end, the Practice must 
be compatible with local goals (1) 

• lack of receptivity of local folks to new ideas (1) 

• LEA'S have own career education plans; problems are solved 
through staff process groups and not "transportable" 
components ( 1 ) 

k. Other Weaknesses 

• in-service needed as part of all adoption/adaption 
efforts (1) 
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^ will need some minor revi s ions ( 1 ) 

too many "strangers to the district Involved In 
the process; RC needs to be involved and role 
not weakened by outsiders (1) 
m. Were pilot efforts ''successfuT'? 

All RC's involved answered 'Ves'* to the question; 
only one said ''minimally'* successful 



Several major observations can be made from the open-ended 
survey responses and the in-person or phone interviews held with 
the Coord inarors. These observations are summarized by thematic 
area and are not made in any particular order of importance. 

1. General relevance of Promising Practices to the Local Situation 

Portland metropolitan area RC's pointed out that many of 
the PP's originated in their districts. They also indicated that many 
parts of the Practices were already operating in their districts. 
As a group, these RC's anticipate little local interest in the future 
in the current Practices listed. What does emerge, though, will need 
to be in response to a pressing local need. 

2. Network Strengthening 

• RC|s should share more at their nxinthly meetings; 
this forum could be usad to update information on 
the PP's and indicate which are no longer operating. 

, RC's need illustrative/descriptive information about 
the PP's; The KJt^ will not provide this 

• the Kit should include a listing of persons who 
participated in PP training/site visitations this 
year; also, the names/add resses/phones of those who 
adopted or adapted a Practice this year should be 

1 isted 

3. Strengthening Evaluation of Promising Practices themselves 

• support should be given to projects like one already 
proposed to ODE to develop competency measures/ 
indicators for career education 

• there is a need for better student follow-up pro- 
cedures which produce useable information for future 
program planning 
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Formal vs. Informal Adoption/Adaption of the Practices 

Several RC's indicated a belief that many of the key 
concepts included in the PP Handbook have already 
been picked up on in the field through informal channels 
(e.g. local individuals directly with Project Directors 
of the Practices). 

Increasing Local Interest 

• Mm more likely to become involved in Projects I've 
actual ly seen 

. consider using newsletters to highlight particular 
groups of Practices or their adoption/adaption' copy 
could be circulated to RC's for inclusion in local 
newsletters 

• develop a snappy brochure which includes a brief 
listing and description of PP's and how to obtain 
assistance with adoption/adaption. 

. need more regional presentations directly to local school 
folks, especially where an RC is disinterested in PP 
or simply lacks time 

. need more publicity materials; would suggest development 
of a slide-tape or other media presentation 

• H. Hall needs to get out in the field more and push 
projects personal ly 

Use of Dol lars 

. most dollars should go to support local adoption/adaption 
and a minimal amount to support other coordinative or 
technical assistance statewide 

. should be able to use the dollars for a wider range of 
career/vocational education innovations, not just those 
formally supported by the ODE 

• Need more accountability; would recommend requiring that 
a local needs assessment be conducted prior to seeking 
funds to adopt or adapt a PP 



. make the use of dollars as flexible as possible 
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• keep the same funding arrangement for one more year 
at least so everyone can get used to it; one hurdle 
is knowing how the system works and the process needs 
more time 

• don't just divide up the money; some regions already 
have more money than others and other regions have 
no interest in the PR's 

The Third Party Coordinator Role 

it makes the RC role less clear; it allows RC's to be 
bypassed 

• staff the position with someone with conference/meeting 
savvy and enough weight to draw people in 

• H. Hall does an excellent job 

« simply put, without someone to keep at it and keep 
others focused on it, PP diffusion will fade away 

« existence of a central coordinator can help with consortium 
development between and among RC's 

• someone is needed to keep RC's up to date and someone 
who RC's can turn to with specific questions, requests 
for referral to the right resource or people, etc. 

• seems as though it would be more expedient if we could 
get support dollars directly from ODE 

• PPs will have more visibility if the RC rather than 
someone else is the major publicizer; and, in the end, 
you can't force a district or school to adopt/adapt 

If they see no need to 

The Adoption/Adaption Process 

• must include mandatory in-service during planning phase 

, need to have more information available about the potential 
costs associated with adopting/adapting and how cost 
efficiencies can be achieved through adoption/adaption 



2k 



Other 



send the RC's copies of PR's which "bombed"; some of the 
ones listed are not fully operational and others seem 
or questionable merit. 

when expanding the PP list, include local projects 
of merit even if they do not quite fit the criteria 
for inclusion as a Promising Practice; indicate how 
they do not quite fit the current criteria 

5.0 CONCLUSIONS AND RECOMMENDATIONS 

Twelve major recommendations are made. Each is preceded by 
a discussion of the major conclusions of the summative evaluation. 

^'^ eVfola ^'"^"^ '"^''^ ^ difference and is it worth a continued 
The existence of the Promising Practices themselves and the 
Diffusion Project have resulted in numerous linkages and informal 
exchanges between Practice developers and those interested in formal 
or informal, partial or full adoption or adaption. It appears doubtful 
that the extensiveness of these exchanges could occur without the 
Practices and the Project. Many local staffs have been exposed to new 
ideas and have been able to experience directly a particular Practice 
by site visitations. Such direct exposure to a Practice seems to be 
the single most influential factor in generating interest in formal 
adoption/adaption. Project funds have made more site visitations 
possible by paying for released time and travel expenses. In a time of 
increasing budget limitations at the local level, such "incentive" 
support, small though it is. has been a particularly important aspect 
of the Project. Finally, the adoption/adaption processes begun this 
year hold the potential for affecting many thousands of students pri- 
marily due to the formation of consortiums through which Practices 
are being implemented. 

Regional Coordinators who were the most involved with adoption/ 
adaption pilot projects this year are. not surprisingly, the same ones 
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who express most support for continuing the project as it is and who 
expect an increase in local interest in adoption/adaption projects 
next year. 

Recommendat ion #1 : The Diffusion Project continue as a 
special project in I98O-8I. Specific recommendations about areas of 
emphasis for the 8O-8I year follow. Additional strengthening of the 
current diffusion model is needed before the "ideal" model can be con- 
sidered "in place". 

5.2 Which components of the Promising Practices diffusion model 
are essential for most effective dissemination of these 
Pract ices? 

There exists strong concensus that both a purgirg (of out-of 
date Practices) and an expansion of the current Handbook listing of 
Practices must take place. The Department of Education is already 
supporting a special project to accomplish both the purging and expansion 
processes. Once this one-shot project ends, however, the issue of 
maintaining currency and updating remains. 

Recommendation #2 : The Department of Education maintain 
an annual process on contract with staff at Oregon State University or 
some other outside agency or organization to purge and update the Pro- 
mising Practices listings using current selection criteria. Such 
listings might most efficiently be stored on tape and further edited, 
purged and updated each year and issued via computer output. With 
an expanded Practice list, such computer storage seems particularly 
important. As well, a larger set of Practices should generate more 
interest in adoption/adaption in many regions. 

Recommendation #3 : Time should be set aside at monthly 
Regional Coordinator meetings for discussion and an exchange of 
information about current Practices operating in the various regiv:)ns. 
Each Coordinator would have the specific responsibility for detailed 
familiarity with Practices in his or her region and keeping others 
up-to-date on Practice currency (e.g. are local staff still available 

o 
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as consultants to others? etc.). These sessions would also provide 
time for the identification of local projects which have not been 
federally or state funded which may qualify as a Promising Practice. 

Recommendation ffk : The Handbook as well as the Ki t should 
include a listing of persons involved with in-service workshops on 
particular Practices and a listing of the names/addresses/phone numbers 
of local adopters/adapters of particular Practices. Such listings 
should help expand the resource network which can be tapped by local 
educators. Further, the Department of Education dissemination list 
for the Handbook should be reviewed and updated each year and recipients 
advised of eliminations and additions to the Practices. 

It appears that local staff awareness of both the existence of the 
Practices and the availability of support for formal adoption/adaption 
remains limited, or, at least less than optimal. Neither the Handbook 
nor the Diffusion Project brochure seem to have yet achieved the desired 
level of awareness. While the Handbook provides more detailed information 
about the Practices, its length may discourage a careful reading by 
many who receive it. 

Unless a Regional Coordinator is particularly aggressive in publicizin 
the Practices in a region, local awareness will probably remain somewhat 
limited. New publicizing strategies are needed. Exclusive reliance 
on the individual efforts of Regional Coordinators for publicizing 
the Practices will most likely not result in a uniformly high level 
of awareness statewide. Time constraints of and, in several instances, 
less than enthusiastic interest in the current list of Practices will 
most likely continue to constrain Coordinator involvement in publicizing. 
Several recommendations are made, therefore, in an effort to increase 
statewide awareness of both the Practices and the diffusion support 
program. 

Recommendation #5 : For I98O-8I, some funds should be used 
to support the development of a brochure for distribution in bulk form 
to Regional Coordinators for their use in publicizing the network 
model. The brochure would include a chart-like listing of the available 
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Practices, including one or two sentence descriptions and contact names/ 

addresses/phone numbers, and a description of how to apply for resource 

support for an adoption or adaption. The current brochure seems to 

be neither eye catching enough nor to include a sufficient amount 

of specific information to encourage maximum use. Such a brochure should 

be updated and reissued each year. 

Recommendation §(>: For I98O-8I, and subject to more discussion 
by the Regional Coordinators, some funds might be used to support the 
development of a short slide-tape program about Promising Practices 
for use by Regional Coordinators with local district and school 
staff as well as for use at various statewide conferences, workshops 
or other key forums involving local instructional and guidance staffs 
and district vocational and career education directors. 

Recommend ation §1 : Department of Education staff, or a de- 
signee of the Department, should periodically issue special feature 
reports on particular Practices and/or adoption/adaption efforts for 
release to Regional Coordinators and for possible incorporation in 
regional newsletters (where they exist). Such special reports could 
highlight Practices by theme area, etc. (e.g. D6H, facilities usage, 
vocational education, etc.). Such an effort is particularly important 
since the current list of Practices will be expanded making the pub- 
licizing challenge even greater. 

For the adoption/adaption process to not only continue at its 
current level but expand, current model components must be maintained. 
Of particular importance is the existence of an easy, short turn- 
around time application process to obtain adoption/adaption support 
dollars and a pool of dollars for use with supporting released time 
for local staff to visit Practice sites and receive travel reimbursement. 
The lack of red tape involved in obtaining the relatively small 
amounts of dollars available to support local adoption/adaption 
planning is essential. As well, direct exposure (in-person) to a 
current Practice and the opportunity to meet and converse with Practice 
Project Directors seems to be the most important single factor affecting 
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the likelihood of adoption/adaption of a Practice. The ability of 
local staff to move out of their local setting to observe an innovation 
on site Is critical . 

Among Regional Coordinators, there is little concensus about 
how best to arrange for the allocation of these local support dollars. 
Two options rejected by all RC's were: making all funds available to 
a particular ragion{s) where either interest in adoption/adaption is 
particularly high or the need for such funds seems to be greatest. 
Seven RC*s approved the process of submitting local project proposals 
directly to ODE staff for review and dollar allocation. Several of 
these same individuals were not sure, however, that ODE staff had the 
time to administer a large number of these small grants. Most of these 
seven also were among the six RC's who favored continuation of the 
role of a third party in the allocation of support dollars. Other 
allocation strategies received relatively little support. 

To date, most (all but two) requests for local support have been 
accommodated, either totally or at least in part. If interest in 
formal adoption/adaption increases, it appears likely that more requests 
will be made than can be accommodated. Some method of selection 
among requests for funding will be needed. Several options seem pos:>!ble 
a) first come, first served; b) preference to requests from regions 
which hertofore have been inactive with formal adoption/adaption 
projects; and c) review of all requests submitted by a specific deadline 
and the attempt to spread available dollars as far as they can go with 
an effort to achieve some degree of geographic spread and equity. 

Recommendation ^8 : Assuming ODE staff do not have the time 
to administer local project funds, contract with a third party to accept 
project requests from Regional Coordinators, review such requests 
and award/administer the funds. Allowance should be made also for 
submission of requests directly from local school district admiastrators 
or staffs. 
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Recommendation /^q : Designate the Regional Coordinators, 
as a group, as the Advisory and Review Committee for the review and 
awarding of local project funds. It is recommended that the RC's. 
at their next monthly meeting, review and discuss the various options 
for selecting projects to fund. It would seem as though option (c) 
above should merit the most serious consideration and that a deadline 
for submission of all local requests will be needed if the process is 
to work. 

Several local adopters/adapters and RC's recommended that an 
initial in-service workshop become a mandatory component of the adoption/ 
adaption initial planning process. Such workshops would bring together 
Project Directors and prospective adopters/adapters and perhaps 
some key local administrators whose support for the Practice is 
essential if it is to move to implementation. The workshops would 
also address issues such as long-term cost implications associated 
with adoption. 

Recommendation #10: All local formal adoption/adaption projects 
should include an in-service component, and the RC Ki_t_ should eventually 
include a section on suggested in-service planning strategies and 
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5.3 Can the diffusion process be expected to continue and/or 
increase in viability without the continued presence of 
a central coordinator, at least in the short-run? 

Eight Coordinators strongly believe that continuation for at least 
one more year of a statewide coordinator is essential to the success 
of the diffusion network model. A review of the recommendations 
already made strongly suggest the need for additional technical and 
adminktrative assistance to both Regional Coordinators and local 
potential adopters/adapters. Local adopters/adapters for 1979-80 
consistently rated high the assistance received from OSU staff. 
Also, RC's who were the most highly involved with pilot adoption/ 
adaption projects this year said continuation of a third party coordinator 
was essential until full awareness of the diffusion process was achieved. 
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Recommendation #1 1 : For 1980-81, a central project director 

be designated to oversee additional publicity development and dissemination 

(see earlier recommendations); to direct the purging, updating and 

expansion of the Practices listings (see earlier recommendation); and to 

coordinate the review/selection process of local projects for funding 

(working with the RC Advisory Committee) and administer the funds. 

Such central coordination could be assumed by an ODE staff member or 

contracted to a third party, such as OSU. Whichever option is selected, 

however, familiarity with the current diffusion model and the Practices 

themsel ves is vi tal . 

5.^ How should the Department of Education allocate dollars 
for the diffusion process in 1980-81? 

Recommendation #12 : Depending on the amount of funds available 
to support the diffusion process in 1980-81, the priorities should be 
ordered as follows, though each is considered an essential and vitally 
needed Project component for long-term achievement of the "ideaT' 
diffusion network model: 1) dollars to support local adoption/adaption 
efforts, 2) additional efforts to publicize both the Practices and the 
availability of funds to support local adoption/adaption planning, and 
3) partial salary support for a project coordinator. 

Earlier recommendations address the question of most preferred 
dollar allocation mechanisms (see #8 and #9). 
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Finally, one issue does not seem to have received a sufficient amount 
of attention either by original Promising Practices developers or 
1979-80 adopters/adapters. It was recommended to the Project Steering 
Committee in March and is again recommended here that more attention 
be given to the development of evaluation strategies, methods, instruments, 
etc. for use in determining the impact of particular Practices, 
particularly on students. Methods of evaluation currently used seem 
to rely heavily on general impressions, informal feedback, and third 
party review. Much more is needed if educators are to respond to requests 
for evidence that the expenditure of dollars for new programs and 
innovations is making a difference. 

Recommendation #13 : The Department of Education seriously 
consider funding a project in I98O-8I designed to produce resource hand- 
book or guidebook for use by local adopters/adapters in designing and 
conducting formative and summative evaluations of career and vocational 
educations of career and vocational education programs designated 
as "Promising Practices". Funds should also be made available to support several 
in-service workshops for local educators using such materials. 



37 



Appendix 



1^ 

^ '.J 

ERIC 



Promising Practices Diffusion Project 
Project Directors Survey 



Please respond to each item with as much detail as possible. Feel free to use 
extra sheets of paper to answer the questions where you have more extensive comments 
and suggestions. Thank you. 



1. Have you, as a project director of an identified Promising Practice, been 
contacted by someone interested in your project? 

no If yes, continue with question 2 

If no, go to question 6 

2. How were you contacted? (Check as many as apply) 
phone 

mail 

visit 

3. How many different times have you been contacted? 
1-5 

5-10 

10-15 

15 or more 

A. In what ways have you provided information or assistance to persons interested 
in your project? (Check all that apply) 

shared copies of materials 

talked on the phone 

a trip to their school to speak to interested persons 

provided technical assistance on a gratis basis 

provided technical assistance on a contractual basis 

5. In your opinion, how did the interested school learn of your proiect'' (Check 
all that apply) 

Regional Coordinator for Career and Vocational Education 

Local Coordinator for Career and Vocational Education 

Promising Practices Diffusion Project 

Professional Publication 

Local Administrator 

Other - please identify 

6. In your opinion, to what extent is there cwareness of the Promising Practices 
projects at the local level? 

Extremely aware 

Somewhat aware 

Little awareness 

No awareness 

7. In your opinion, do you think efforts to disseminate Promising Practices 
should continue? 

Not at all 

At some limited level 

High priority level 

8. Please feel free to suggest strategies you would like to see attempted or 
ideas you have regarding Promising Practices. 

Return to: Helen Hall, Pro. Dir. 

20 Milam Hall OSU 
Corvallis OR 97331 



SURVEY OF LOCAL AWARENESS 
OF PROMISING PRACTICES PROGRAM 



Dear Colleague: As part of the Promising Practices Diffusion Project in 

Vocational and Career Education in Oregon, we are attempt^ 
ing to determine general awareness of this program around 
the state. Your responses are especially important. Please 
answer the few questions below and return the form In the 
attached envelope by May 1, 1980. Thank you. 



Dr. Helen Hall, Project Director 
20 Milam Hall 
Oregon State University 
Corvallis OR 97331 



In the past, have you received a publication entitled, Promis ing Practices 
in Oregon (orange cover)? ° irLdCLxces 

Have you read through the above publication? 

Not applicable Yes, scanned it Yes, read thoroughly 

No, passed it to others No 



Have you shared it with others? 

Not applicable Yes No 

In the past, have you ever followed up for more information on a 
particular Practice listed in the publication? 

Yes No 



In the future, do you plan to follow up for more information on a 
particular Practice? 

Yes No Not sure 



Have you or local colleagues been interested in adopting one or more 
of these Practices? 

Yes No 



In the past, have you received a brochure describing the Promising 
Practices Diffusion Project? 

Ves No Not sure 



8. Any comments, suggestions, etc. about the Promising Practices publication . 
— Please return in the attached envelope 
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CHECKLIST OF INFORMATION NEEDED FROM HELEN HALL 
ON THE PROMISING PRACTICES DIFFUSION PROJECT 

Needed by: June 20th 



^- * description of your contacts with the Regional Coordinators(e .g . hovv 

many; how-phone/meetlng, etc.} where; when; Issues addressed) 

2. a listlnc of the number and kind of Promising Practices which were 

supported to be adopted or adapted this ycir(e.g. name of school or 
district Involved; the specific PP involved; whether adopted or adapted; 
number of local staff involved; and total dollars allocated to suooort 
this PP) 



3* •urveys which Lou Thomas distributed to those who attended the special 

regional meeting I attended 

surveys( review sheets) sent to the RCs for use in reviewing the draft 

version of the Implementation Kit 

»urveys from the project directors of the listed Promising Practices 

(see green, 1-page form) 

®- •urveys of Local Awareness of Promising Practices Program(yellow, 1 page) 

^- * ^ iption of responses to your Feb. 5th memo to RCs about "practices" 

nc uded in the orange booklet, Promising Practices(see form you 

atv si, "Promising Practices Information Sheet") 

8. a description of the number and kinds of field visits you have made during 

the project year (e.g. to local adoption/adaptation sites) 

number and kind of inquiries you have directly received from individuals 

other than RCs about the Promising Practices Program 

10.* From what you have learned, how up-to-date is the lisitng of PPs on 

p»33 of the draft Implementation Kit and in particular, how up-to-date 
arc the "disadvantaged/handicapped promising practices listed? 

11«* Where, in your view, do we currently have in place the "best" model 

process of a regional system for the dissemination and implementation 

of PP? and what are the most critical components which make it a "model"? 

12.* In the future, what kind of cooperation with the ICEE(%Art Terry) or 

other groups/agencies do you envision for PP? 

13 • What kind of in-service training has taken place for local adopters/adapters 

in connection with the Project this year(e.g. who conducted it; for which 
audienc^is; who attended)! 

li«t the ways the existence of the Project was publicized this yeAr and 

which audiences each strategy was designed to reach(e.g. brochure, special 
meetings attended, etc.) 

15.* What do you s^ee to be the key strengths and weaknesses of the PP model 

process pilot-tested this year? 
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page two, Checklist 



What should be done next to ensure further implementation and on-going 

functioning of the model process in Oregon? Do you believe the system 

can work if it involves only RCs and ODE staff or are other components needed? 

17.* Overall, what have been the highpoints and any sources of frustration which 

have accompanied project activities this year? 

18 •* Given stated/ formal project goals, to what extent have they been achieved? 

What has limited achievement of one or more of them, if any? 

19 •* Other concerns and thoughts you have about the future of PP in Oregon. 



*can provide information to these questions in writing, phone interview, or in~ 
person meeting if we can arrange one 



Regional Coordinator Review of Draft Copy 
°^ Promising Practices Diffusion Prn^ grt! 
Implementation Kit for Regional Coordin ators 



J ^^ feedback on the Kit will help us develop the final version. Please 
b2 as thorough and critical of the current version of the Kit as possible 

lltllt ''f'"" " AP'^il 18. -Please use ext;a 

!n! ^aafoff ""^^ questions where you have more extensive comments 

and Suggestions. Thank you. 



A. Your Overall Impression of the Kit 

1. Does the Kit contain information you have already found or believe 
you will find useful? Which section or sections strike you as the 
most and the least useful in the current draft? 



How does it read? Easily? Rough in places? Please comment. 



Are there topics, issue areas, resource lists, etc. you think should 
be covered in the Kit? VJhat are they? 



Do the diffusion implementation processes described (e.g. informing 
assessing, etc.) seem workable? Does the Kit contain enough information 
to make each process clear? Are there some areas which should be 
expanded? Cut-back? 
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B. Please read through each section of the Kit and attach any coments, suggestions you have. 



Sections Fine as is? 



Introduction 

Informing 

Assessing 

-Suniinary Chart (p. 9) 

-Checklist (p. 10-11) 
Endorsing 
Planning 

-Planning Worksheet 
Implementing 
Evaluating 

-Figure 1 

-Evaluation Checklist 
-Evaluation Worksheet 

Appendix A 

Appendix B 

Appendix C 



Coments? (Please use additional 



— M sheets of paper if needed) 



May 27, 1980 



3405 SW Carolina 
Portland, Oregon 97201 
(503) 246-8371 



Dear Colleague: 

As a local adopter or adapter of a Promising Practice, 
faoilitated by the Oregon State University Promising Practices 
Diffusion Project, we need your thoughts about both the project 
and the implementation process you have used this year. Your 
responses to the attached questionnaire will remain confidential 
and will be incorporated into a final project report to assist 
with future project decisions and improvements. 

If you are interested in reviewing a summary of the survey, 
contact Eugene Vinarskai at the Oregon Department of Education 
in Salem this summer or early Fall. 

Please complete the survey as soon as possible and return 
it in the enclosed envelop by June 6, 1980. Thank you very much 
for your important contribution. If you have any questions, 
please feel free to contact me at my Portland number. 




Sincerely 



Mary K. Kinnick 
Third Party Evaluator 
Promising Practices 



Diffusion Project 



(attachment) 
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PROMISING PRACTICES DIFFUSION PROJECT 
Local Adopter/Adapter Survey 



Name of the Promising Practice 
Name of Your School/Location 
Your Position with the Project 



Are you: ^adopting a practice in total? adapting a practice? 

^adopting part of a practice? 

Please briefly describe your activities with the process of adopting or adapting 
the Promising Practice this school year (e.g. what did you do and/or are you 
still doing?) 



1. How did you first become aware of the Promising Practices program? 

Promising Practices publication ^school administrator 

ESD Regional Coordinator teacher/counselor colleague 

ODE staff member pother, please spe4:ify 



2. What were the primary reasons you elected to become involved with imple- 
menting a Promising Practice this year? 



3. How many students in your school participated in any class or program which 
used a Promising Practice in whole or in part this past school year? 



number 



4. How many staff members in your school participated in one or more aspect! 
of the adopting or adapting process of a Promising Practice this past 
school year? 

number ^ 
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What klnd(s) of assistance did you use in adopting or adapting the 
Promising Practice? And, how useful was each kind of assistance? Please 
rate the usefulness of each kind of assistance you used. 





Assistance 


Used Did Not Use 
Because: 

Not Did Not 
Available Need 


Usefulness 
Low Medium High 


assistance by phone from 
original project staff 

assistance in person from 
original project staff 

admin, assistance from 

ESD Rpffional Cnn-rA 

technical assistance from 
ESD Regional Coord. 

assistance from OSU 
Promising Practices 
staff (e.g. Hall, Fancher) 

assistance from an out- 
side consultant not paid 







for by Project funds 

assistance from an out- 
side consultant paid for 
by Project funds 

other "people-related" 
assistance, please specify: 



dollars to suppc t released 
time for staff 

dollars to pay for substi- 
tute staff 

dollars for supplies and 
services and/or equipment 

dollars for travel reim- 
bursement 
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5. continued 



Assistance 



Used Did Not Use 
Because: 

Not Did Not 
Available Need 



Usefulness 



Low Medium High 



other "dollar-related" 
assistance, please specify: 



written materials about the 
original project 

In-servlce training program 
prior to Implementing the 
Practice 

other assistance, please 
spef Ify:^ 




Other than what you may have added to Items In question #5 above, were 
there other kinds of assistance you needed which were not available? 



Yes >What? 

No 



Do you plan to continue the Practice this coming school year? 
No ^y not? 



Jfes, for about the same number of students 

Jfes, but will expand to Involve more students ^ow many total? 



What evidence do you have that the Practice achieved the desired outcomes? 
(check all that apply) 



^really don't have any 

_too early to tell 

^Impressions of staff only 

^Informal student feedback 

^formal student feedback; 
self-report Instrument used 



pre/post testing or assessment of student 

learning outcomes 

^use of student performance or behavioral 

measures 

use of third party evaluator 

o ther, please describe 
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9* In your view, should support for the Promising Practices Diffusion 
Project continue? 

Yes, as is 

X®s» with some changes (see question below) 

No 

10, What changes, if any, would you suggest be made in the Promising Practi 
Diffusion Project? 



11. Overall, what have been the most important factors which have 

facilitated the adoption or adaptation process you have used this 
year? 



. Overall, what have been some important factors which have limited 
made more difficult the adoption or adaptation process you have 
used this year? 



-PLEASE RETURN IN THE ATTACHED ENVELOP BY JUNE 6th- 
THANK you: 
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3405 SV: Carolina 
Portland, Oregon 97201 
(503) 246-8371 



MEf'tORANDUr.l 



TO; ESD Regional Coordinators 

FRG.V: Mary K. Kinnid^^ird Party Evaluator, Promising Practices 
Diffusion Project 



I am currently serving as the Third Party Evaluator to the 
Oreoon State University-based Promising Practices Diffusion Project. 
Your views and suggestions about the Project constitute vital infor- 
rration to be considered by Department of Education staff when the 
future direction of this program is reviewed this summer. 

Please complete the attached survey as soon as possible. It 
appears to be long but should not take long to complete. I have 
arranged to meet with Coordinators in the Portland area(Multnomah, 
Clackamas and U^ashington counties) to discuss survey responses in' 
person and will plan to contact everyone else by phone between June 
3 and 13. Please do not send back the survey (in the enclosed 
enveloD) until after I have contacted you. Your responses will 
remain confidential and will be summarized in a final evaluation 
report submitted to the Department of Education. 

Thanks very much, and I will try to keep phone interview time 
to a minimum* 



PROWISING PRACTICES DIFFUSION PROJECT 
ESD Regional Coordinator Survey 



ur Name 



The Promising Practices Diffusion Project has as a major purpose the 
improvement and upgrading of career and vocational education in Oregon. 
V;hich of the following best expresses your thoughts about this Project: 

it should be continued as is 

in concept I support it, but substantial changes are needed 

it should not be continued 

other, please specify 



As you. understand it, what are your formal responsibilities and aeneral 
role with the Project? Are they clear? 



Please briefly describe your involvement with the Project this year. In 
particular, what specific things have you done to increase local awarene 
about and interest in adopting or adapting a Promisino Practice for this 
year or next? 



How much emphasis are you placing on Promising Practices-related activities 
compared with your other program of work activities? 

much less more 

less much more 

about the same 



In your view, how compatible are Promising Practices-related objectives and 
activities with the accomplishment of your other work objectives? 

not very compatible , 

somewhat compatible 

very compatible 
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®* S^nir^^ T ^f'!^^""^'^^^^^^ expect you to place much emphasiu on 
Promising Practices-related activities? 



"° yes, quite a bit 

yes, some 



^' ProjlTt7 ^'^-^"^'^^ your necion of the Pnomisin, Practices Diffusion 

don't know somewhat aware 

"o* very aware very aware 

8. What are the grimary ways local educators learn about Promisino Practices 
and opportunities to adopt or adapt a particular practice? 



0. 



^racrice/°'^' expressed in adopting or adapting a 



a. How many inquiries have you received this year? 

b. Were you able to accomodate all of the expressed interest? 

yes no 

c. Do you expect a change in the level of local interest for 
next year? 

no, about the same 

yes, less interest 

yes, more interest 

10, As the Project is currently designed, the Regional Coordinator(RC) network 
IS expected to maintain the on-going model Promising Practices Diffusion 
system process xn the future. The Implementation Kit for Regional Coordi- 
nators(which you reviewed earlier and is currently being finalized) win 

will the RC network alone, without central coordination and tech^icll 
assistance from a third-party agency such as OSU this year, be sufficient 
to maintain project viability? ' s^TTicient 



ERIC 
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11. Several suggestions have been made about how best to use future federal 

^H^c^r^or^'^^"' to support the diffusion of promising career and vocational 

P?ease cH^r'^?"' ^""^ °' suggestions are listed below. 

Please check all you support and add others which occur to you. 

(/) 

continue to allocate dollars to support the current diffusion model 

make all funds available to a particular region(s) of the state 

where interest in adopting/adapting one or more practices is high 
make all funds available to a particular region(s) of the state 

where it is determined need for improvement and innovation is greatest 
continue to fund a third party facilitator(e.g. like OSU) to 

provide technical assistance to local adopter/adapter staff 

and facilitate the implementation process 

divide-up all dollars among ESD's and use for pre-arranged priority 

adoption/adaptation projects « h ■ t-j- 

devote considerable energy to expanding the currest list of 

practices which meet current Promisino Practices criteria and 
allow dollars to be used to adopt/adapt from this expanded list 
of practices 

devote some energy to improving the use of evaluative measures/ 

strategies at the local level to see if adopted or adapted practices 
are achieving the desired outcomes 

have RC's submit local project prop6sals(to adopt/adapt a Promisino 

Practice) directly to Department of Education staff for review 
and dollar allocation 

have Department of Education staff target dollars to one or 

more special Promising Practices for diffusion 

other, please specify 



12. Overall, what do you believe ^.re the current strengths and weaknesses of 
the Promising Practices Diffusion Project effort? and what changes, if any 
would you Suggest? ^ * ^* 
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Please complete itom ff 13 only if your reGion 
has been involved with udoptir^c or ada|.rtin£; a 
Promising Practice this school year 



13. Do you consider the pilot effort (a) successful? Uhy or why not and 
v^hat sueoestions do you have for improving future such efforts? 



PLEASE RETAIN THE SURVEY UNTIL AFTER K. KINNICK HAS CONTACTED YOU 

IN PERSON OR BY PHONE; THEN RETURN THE SURVEY IN THE ENCLOSED ENVELOP 

THANK YOU 



ERIC 



